Correction of vibration-induced error for touch screen display in an aircraft

ABSTRACT

Systems and methods for correcting a vibration-induced error on a touch screen display device on an aircraft are provided. A method can include providing a user interface for display on a touch screen display device. The user interface can include one or more virtual elements associated with functions to be performed by a component of the aircraft. The method can include receiving data indicative of an actual user interaction with the touch screen display device. The method can include receiving data indicative of an intended user interaction. The method can include receiving data indicative of a sensed vibration. The method can include determining a corrected user interaction corresponding to a selected virtual element based on the data received. The method can also include sending one or more command signals to one or more components to perform a function associated with the selected virtual element.

FIELD OF THE INVENTION

The present subject matter relates generally to correction of avibration-induced error for a touch screen display, and moreparticularly, to correction of a vibration-induced error for a touchscreen display in an aircraft.

BACKGROUND OF THE INVENTION

During aircraft operation, flight crew members can use touch screendisplay devices to perform various functions, such as input flight plandata or check weather conditions nearby. These touch screen displaydevices can allow for quick and efficient input and review of data andflight conditions, while condensing the function of several componentsinto a single screen. The touch screen display device can display one ormore user interfaces, which can be navigated by selecting virtualelements displayed on the touch screen display device with, for example,a finger or stylus.

However, during operation, the aircraft may encounter turbulence,gravitational forces, or mechanical vibrations, which can cause theflight crew member to have difficulty controlling his or her movement.In some cases, flight conditions can be so severe as to cause a flightcrew member intending to select a particular element on a touch screendisplay device to inadvertently select an unintended element. The flightcrew member may then need to re-enter the intended input on the touchscreen display device, which may require navigating backwards throughthe user interface. This can lead to frustration on the part of theflight crew members and decreased efficiency due the need to re-enterthe intended selection on the touch screen display device.

BRIEF DESCRIPTION

Aspects and advantages of the present disclosure will be set forth inpart in the following description, or may be learned from thedescription, or may be learned through practice of the examplesdisclosed herein.

One example aspect of the present disclosure is directed to acomputer-implemented method of correcting a vibration-induced inputerror on a touch screen display on an aircraft. The method can includeproviding for display, by one or more processors, a user interface on atouch screen display. The user interface can include one or moreinteractive virtual elements. Each virtual element can be associatedwith a function to be performed by a component of the aircraft duringoperation of the aircraft. The method can also include receiving, by theone or more processors, data indicative of an actual user interactionwith the touch screen display. The method can also include receiving, bythe one or more processors, data indicative of an intended userinteraction. The method can also include receiving, by the one or moreprocessors, data indicative of a sensed vibration from one or morevibration sensors located on the aircraft. The method can also includedetermining, by the one or more processors, a corrected user interactioncorresponding to at least one selected virtual element based at least inpart on the data indicative of the actual user interaction, the dataindicative of the intended user interaction, and the data indicative ofthe sensed vibration. In response to the corrected user interaction, themethod can also include sending, by the one or more processors, one ormore command signals to one or more components of an aircraft to performat least a portion of the function associated with the at least oneselected virtual element.

Another example aspect of the present disclosure is directed to a systemfor correcting a vibration-induced input error on a touch screen displayon an aircraft. The system can include a touch screen display deviceconfigured to display a user interface. The user interface can includeone or more interactive virtual elements. Each virtual element can beassociated with a function to be performed by a component of theaircraft during operation of the aircraft. The system can also includeone or more vibration sensors located on the aircraft configured toobtain data indicative of a sensed vibration. The system can alsoinclude one or more tracking devices configured to obtain dataindicative of an intended user interaction. The system can also includea control system configured to receive data indicative of an actual userinteraction with at least one virtual element, receive data indicativeof an intended user interaction, receive data indicative of a sensedvibration, determine a corrected user interaction corresponding to atleast one selected virtual element based at least in part on the dataindicative of the actual user interaction, the data indicative of theintended user interaction, and the data indicative of the sensedvibration, and in response to the corrected user interaction, to sendone or more command signals to one or more components of the aircraft toperform at least a portion of the task associated with the at least oneselected virtual element.

Yet another example aspect of the present disclosure is directed to anaircraft. The aircraft can include an engine. The aircraft can alsoinclude a fuselage. The aircraft can also include one or more vibrationsensors. The aircraft can also include one or more tracking devices. Theaircraft can also include a touch screen display device. The aircraftcan also include a controller comprising one or more processors and oneor more memory devices located on an aircraft. The one or more memorydevices can store instructions that when executed by the one or moreprocessors cause the one or more processors to perform operations. Theoperations can include providing for display a user interface on thetouch screen display. The user interface can include one or moreinteractive virtual elements. Each virtual element can be associatedwith a function to be performed by a component of the aircraft duringoperation of the aircraft. The operations can also include receivingdata indicative of an actual user interaction with the touch screendisplay. The operations can also include receiving data indicative of anintended user interaction from the one or more tracking devices. Theoperations can also include receiving data indicative of a sensedvibration from the one or more vibration sensors. The operations canalso include determining a corrected user interaction corresponding toat least one selected virtual element based at least in part on the dataindicative of the actual user interaction, the data indicative of theintended user interaction, and the data indicative of the sensedvibration. In response to the corrected user interaction, the operationscan also include sending one or more command signals to one or morecomponents of an aircraft to perform at least a portion of the functionassociated with the at least one selected virtual element.

Other example aspects of the present disclosure are directed to systems,methods, aircraft, avionics systems, devices, and non-transitorycomputer-readable media for correcting a vibration-induced error on atouch screen display device on an aircraft.

Variations and modifications can be made to these example aspects of thepresent disclosure.

These and other features, aspects and advantages of various embodimentswill become better understood with reference to the followingdescription and appended claims. The accompanying drawings, which areincorporated in and constitute a part of this specification, illustrateembodiments of the present disclosure and, together with thedescription, serve to explain the related principles.

BRIEF DESCRIPTION OF THE DRAWINGS

Detailed discussion of embodiments directed to one of ordinary skill inthe art are set forth in the specification, which makes reference to theappended figures, in which:

FIG. 1 depicts a perspective view of an example portion of an aircraftaccording to example aspects of the present disclosure;

FIG. 2 depicts an schematic of an example interaction with a userinterface addressed by the present disclosure;

FIG. 3 depicts a schematic of an example interaction with a userinterface according to example aspects of the present disclosure.

FIG. 4 depicts a schematic of an example interaction with a userinterface according to example aspects of the present disclosure.

FIG. 5 depicts an example method according to example aspects of thepresent disclosure.

FIG. 6 depicts an example method according to example aspects of thepresent disclosure.

FIG. 7 depicts an example system according to example aspects of thepresent disclosure.

DETAILED DESCRIPTION OF THE INVENTION

Reference now will be made in detail to embodiments of the invention,one or more examples of which are illustrated in the drawings. Eachexample is provided by way of explanation of the invention, notlimitation of the invention. In fact, it will be apparent to thoseskilled in the art that various modifications and variations can be madein the present invention without departing from the scope or spirit ofthe invention. For instance, features illustrated or described as partof one embodiment can be used with another embodiment to yield a stillfurther embodiment. Thus, it is intended that the present inventioncovers such modifications and variations as come within the scope of theappended claims and their equivalents.

Example aspects of the present disclosure are directed to systems andmethods for correcting a vibration-induced error with a touch screendisplay device on an aircraft. Touch screen display devices can be usedby flight crew members to input and review data and flight conditionsduring operation of an aircraft. A user interface can be displayed onthe touch screen display device, which can allow a flight crew member tonavigate through various menus by selecting virtual elements displayedon the screen. For example, a flight crew member can input flight planinformation into a flight control system by selecting a virtual elementdisplayed on the touch screen display device corresponding to a flightplan by touching the virtual element with, for example, a finger or astylus. Once the flight plan virtual element has been selected, a newmenu with additional input options and/or information can be displayedto allow for quick and efficient entry of flight plan information.

During operation of the aircraft, however, flight conditions can causeflight crew members to have difficulty selecting a particular virtualelement displayed on a touch screen display device. For example, anaircraft may encounter turbulence, gravitational effects, or mechanicalvibration, which can cause a flight crew member to inadvertently selectan element on a touch screen display device that was not the intendedelement. In such a case, the flight crew member may need to re-enter thecorrect selection, which can cause frustration for the flight crewmember, and decrease the efficiency provided by using a touch screendisplay device. Further, if the vibrating flight conditions continue fora period of time, the flight crew member may have difficulty re-enteringthe correct selection, which can further exacerbate the flight crewmember's frustration, and lead to further decreases in efficiency.

The systems and methods according to example aspects of the presentdisclosure can correct for vibration-induced input errors on a touchscreen display device on an aircraft. For example, the systems andmethods can provide a user interface on a touch screen display device ina cockpit of an aircraft. The user interface can include one or morevirtual elements corresponding to various functions to be performed byone or more components of the aircraft. For example, a user interfacecan include virtual elements corresponding to a flight plan or weatherconditions, which, when selected, can allow for entry of flight planinformation or display of weather conditions, respectively. A flightcrew member can interact with the virtual element (e.g., via a touchinteraction with, for example, a finger or stylus) to complete theassociated task.

A processor can be configured to receive data indicative of an actualuser interaction with the touch screen display device, such as an inputfrom the flight crew member. For example, when a flight crew memberselects a virtual element by, for instance, touching the virtual elementon the touch screen display device with the flight crew member's finger,the processor can receive data indicative of the selected virtualelement.

The processor can be further configured to receive data from one or morevibration sensors located on the aircraft. For example, anaccelerometer, velocity sensor, laser displacement sensor, proximityprobe, or other vibration sensor can be located in a cockpit of anaircraft. The vibration sensor can be configured to sense a vibration,such as a vibration due to turbulence, gravitational force, ormechanical vibration, and send data indicative of the sensed vibration(e.g., data indicative of the duration and magnitude of the vibration)to the processor. Using this data, the processor can determine if aflight crew member's interaction with a touch screen display device wascoincident with a sensed vibration, which can indicate an input errormay have occurred.

The processor can be further configured to receive data indicative of anintended user interaction. For example, one or more tracking devices canbe configured to track the flight crew member's interaction with thetouch screen device. For example, in an embodiment, a camera can beconfigured to track a flight crew member's eye movement, and furtherconfigured to provide the processor data indicative of the object ofvisual focus of the flight crew member as the flight crew memberinteracts with the touch screen display device. The object of visualfocus of the flight crew member can indicate the flight crew memberintended to select an element corresponding to the object of the flightcrew member's focus. Using this data, the processor can calculate aninput error, such as a difference from an actual user interaction andthe intended user interaction, as determined by the object of the flightcrew member's focus.

In an embodiment, a tracking device, such as a camera, can be configuredto track the movement of an input device used by a flight crew member tomake a selection on the touch screen display device. For example, aninput device can be the flight crew member's finger, hand, arm, or anobject held by the flight crew member, such as a stylus. As used herein,the term “stylus” refers to any object used by a flight crew member tointeract with a touch screen display device, and can include, withoutlimitation, a capacitive stylus, a Wacom digitizer, a Bluetooth enabledstylus, a writing instrument, or any other device used to interact witha touch screen display device. As the flight crew member interacts withthe touch screen display device, the tracking device can be configuredto track the movement of the input device. Data indicative of themovement of the input device can then be provided to the processor,which can model the movement of the input device as it interacts withthe touch screen display device. Using this data, the processor cancalculate an intended user interaction based on the trajectory of thedevice and a sensed vibration. For example, a processor can beconfigured to model a user interaction had a sensed vibration notoccurred. Using this data, the processor can calculate an input error,such as a difference from an actual user interaction and an intendeduser interaction, as determined based on the tracked movement of theinput device.

Using the data indicative of a sensed vibration, the processor can befurther configured to determine a disturbance probability. For example,a processor can be configured to determine a probability that an inputerror was caused by a sensed vibration. For example, if an input erroris very high, but little to no sensed vibration occurred prior to orduring the user interaction, a disturbance probability can be calculatedthat may indicate a low likelihood that the input error was caused bythe sensed vibration. However, if an input error is very high, and asimilarly high sensed vibration occurred prior to or during the userinteraction, a disturbance probability can be calculated that mayindicate a high likelihood that the input error was caused by the sensedvibration.

Based on the input error and the disturbance probability, the processorcan determine a corrected user interaction. For example, if adisturbance probability is not high enough for a sensed vibration tohave likely caused the input error, the processor can determine thecorrected user interaction is the actual user interaction. However, if adisturbance probability is high enough for a sensed vibration to havelikely caused an input error, the processor can determine a correcteduser interaction based on the actual user interaction and the inputerror. For example, an actual user interaction may correspond with afirst virtual element displayed at a first location on a user interface.However, an input error may indicate that a second virtual elementlocated at a second position on the user interface was an intended userinteraction. The processor can be configured to determine that thedisturbance probability was sufficiently high for the sensed vibrationto cause the input error, and correct the actual user interaction to thesecond location corresponding to the second virtual element by adjustingthe actual user interaction by the input error. The processor can thensend one or more command signals to one or more components of theaircraft to perform a function associated with the second virtualelement. For example, the processor may send one or more command signalswith a remote device, such as a control device located on the aircraft.Alternatively, the one or more control signals may be one or moreinstructions performed by the processor itself.

In this way, the systems and methods according to example aspects of thepresent disclosure can correct a vibration-induced error on a touchscreen display device on an aircraft. The example systems and methods ofthe present disclosure can have a technical effect of reducinginteraction errors, reducing flight crew member frustration, andincreasing efficiencies associated with touch screen display deviceinteractions.

With reference now to the FIGS., example embodiments of the presentdisclosure will be discussed in further detail. FIG. 1 depicts aperspective view of an example portion of an aircraft 100 according toexample embodiments of the present disclosure. The aircraft 100 caninclude, for instance, a cockpit 102, an engine 140, and a fuselage 150.A first user (e.g., a first flight crew member, a pilot) can be presentin a seat 104 at the left side of the cockpit 102 and another user(e.g., a second flight crew member, a co-pilot) can be present at theright side of the cockpit 102 in a seat 106. The aircraft 100 caninclude a flight deck 108, which can include one or more multifunctionalflight display devices 110, which can be one or more touch screendisplay devices 118. The aircraft can also include one or moreinstruments 112. In some implementations, the one or more instruments112 can be located on the flight deck 108 in front of the one or moreusers and can provide information to aid in flying the aircraft 100.

Aircraft 100 can include one or more physical control interfaces 116. Aphysical control interface 116 can be, for example, a control interfacethat is configured to adjust a setting, parameter, mechanism, and/orcondition of the aircraft 100. The physical control interfaces 116 caninclude, for instance, a button, momentary push button, compressiblebutton, a switch mechanism, sliding control, level, knob, gauge, etc.

The aircraft 100 can include one or more aircraft input devices 114(e.g., in the cockpit 102) that can be used by one or more users toprovide input to one or more processors and interact with the systems ofthe aircraft 100. The aircraft input devices 114 can include, forinstance, any device suitable to accept input from a user and to convertthat input to a graphical position on any of the multiple flight displayscreens 110. For instance, the one or more aircraft input devices 114can include a joystick, multi-way rocker switches, mouse, trackball,keyboard, touch screen, touch pad, data entry keys, a microphonesuitable for voice recognition, or any other suitable device. In someimplementations, each user can have one or more separate aircraft inputdevices 114. Through use of the aircraft input devices 114, the one ormore users can interact with the graphic and/or textual data elementsprovided for display on the screens of the display devices 110.

One or more user interfaces 120 can be displayed on the one or moredisplay devices 110, including one or more touch screen display devices118. For availability, one or more of the user interfaces 120 can beprovided by a display device 110 on each side of the flight deck 108. Insome implementations, one or more of the display devices 110 can betouch screen display devices 118 that can allow a user to visualize theuser interface 120 on the touch screen display device 118 and interactwith the user interface 120 through the touch screen display device 118.Additionally and/or alternatively, one or more of the display devices110 can be operably coupled with the input devices 114 such that a usercan interact with the user interface 120 (e.g., cursor interaction viatrackball, mouse, etc.) and the textual and/or graphical elementsincluded in the user interface 120.

According to example aspects of the present disclosure, the userinterface 120 can include one or more virtual elements displayed on atouch screen display device 118. A user, such as a flight crew member,can interact with the virtual element through an actual userinteraction. In one example, the virtual element can be a visualrepresentation of a push button, and an associated actual userinteraction can be, for example, a pushing touch interaction on thetouch screen display device 118 to perform a function associated withthe virtual element.

Each virtual element can be associated with a task to be performed byone or more components of the aircraft. A task can include one or moreprocedures that are required or recommended to be performed foroperation of the aircraft 100. The one or more tasks can includeprocedures that are to be performed before, during, and/or after theoperation of the aircraft 100. For instance, a task can include turningon window heat, arming emergency exit lights, checking fire warning,checking voice recorder, setting pressurization, checking instruments112, verifying fuel quantity, releasing a parking brake, turning on abeacon, adjusting engine anti-ice, setting flaps, locking the cockpitdoor, turning on pilot heat, checking a transponder, adjusting landinglights, etc. Additionally, the one or more tasks can include one or morefunctions to be performed or displayed by the touch screen displaydevice 118, such as opening a flight plan menu to allow a flight crewmember to enter flight plan information or displaying weather conditioninformation.

The one or more display devices 110, including one or more touch screendisplay devices 118, can be configured to be in wired and/or wirelesscommunication with a control system 130. For instance, in someimplementations, a touch screen display device 118 can communicate withthe control system 130 via a network. The one or more touch screendisplay devices 118 can be configured to receive an actual userinteraction with the user interface 120 and to provide data indicativeof the actual user interaction to the control system 130. For instance,a user can provide a touch interaction with one or more virtual elementsvia a touch screen of touch screen display device 118. One or more ofthe touch screen display devices 118 can send data indicative of theactual user interaction with the virtual element to the control system130. The control system 130 can be configured to receive data indicativeof the actual user interaction with the virtual element.

A cockpit 102 can also include one or more tracking devices 160. The oneor more tracking devices 160 can be configured to track a userinteraction with a touch screen display device 118. For example, in anembodiment, a tracking device 160 can be a camera configured to track aflight crew member's movement and/or vision as the flight crew memberinteracts with a touch screen display device 118. As will be discussedin greater detail with respect to FIGS. 3 and 4, a tracking device 160can be configured to provide data indicative of an intended userinteraction to a control system 130.

The aircraft 100 can also include one or more vibration sensors 170located on the aircraft, such as, for example, in the cockpit 102. Theone or more vibration sensors 170 can be configured to sense aturbulence, a gravitational force, or a mechanical vibration. The one ormore vibration sensors can be one or more accelerometers, velocitysensors, laser displacement sensors, proximity probes, or any othervibration sensor configured to sense a vibration. The control system 130can further be configured to receive data indicative of a sensedvibration from the one or more vibration sensors 170 located on theaircraft 100.

In response to receiving the data indicative of an actual userinteraction with a touch screen display device 118, the data indicativeof an intended user interaction from the one or more tracking devices160, and the data indicative of a sensed vibration from one or morevibration sensors 170, the control system 130, and more particularly, aprocessor in the control system 130, can be configured to determine acorrected user interaction corresponding to at least one selectedvirtual element on a user interface 120 displayed on a touch screendisplay device 118. The corrected user interaction can be an actual userinteraction corrected for a vibration-induced error.

In response to determining the corrected user interaction, the controlsystem 130 can be configured to send one or more signals (e.g., commandsignals) to one or more aircraft components (not shown) to complete thetask associated with the selected virtual element. The control system130 can be in wired or wireless communication with the one or moreaircraft components. Additionally, and/or alternatively, the controlsystem 130 can be configured to communicate with the aircraft componentsvia a network. The one or more aircraft components can be one or morecontrol devices configured to adjust, set, and/or otherwise change aparameter, state, mechanism, and/or condition of an aircraft.Additionally, the one or more aircraft components can include one ormore touch screen display devices 118, and the task can be aninteraction with a user interface 120 displayed on the one or more touchscreen display devices 118, such as navigating through one or more menusto enter or access data or information displayed on the touch screendisplay device 118. For example, a task can include opening a flightplan menu on a touch screen display device 118 to allow a flight crewmember to enter flight plan information.

In response to receiving the one or more command signals, the aircraftcomponents can execute a control action to complete at least a portionof the task. For instance, in response to receiving one or more commandsignals to display a flight plan menu, the touch screen display device118 can then display the current flight plan for the aircraft 100.Similarly, a corrected user interaction with a touch screen displaydevice 118 can be used to control one or more control devices tocomplete a task associated with operation of an aircraft, such as, forexample, setting a cabin pressurization setting or turning on a cabinheating unit.

Referring now to FIG. 2, a schematic of an example interaction with auser interface is provided. As depicted, a user interface 120 isdisplayed on a touch screen display device 118. As shown, the userinterface 120 can include one or more virtual elements 202. For example,as depicted, four virtual elements 202A-D are shown. Each virtualelement 202 can be associated with a function to be performed duringoperation of the aircraft 100. For example, virtual element 202A can beassociated with a flight plan, which, when selected, can allow for theentry and review of flight plan information. Virtual element 202B can beassociated with a terrain map, which, when selected, can allow for agraphical depiction of nearby terrain conditions. Virtual element 202Ccan be associated with weather conditions, which, when selected, canallow for display of weather conditions. Virtual element 202D can beassociated with air traffic conditions, which, when selected, can allowfor display of nearby air traffic, such as other aircraft in thevicinity.

Referring still to FIG. 2, an input device 204 can be used to interactwith a user interface 120 displayed on a touch screen display device118. For example, as depicted in FIG. 2, a user is interacting with auser interface by touching the one or more virtual elements with theuser's finger. In another embodiment, an input device 120 could be ahand, an arm, or a stylus. As shown, a user may intend to interact witha particular virtual element 202 displayed on a user interface 120. Forexample, as shown, a line A corresponding to an intended userinteraction is shown. As shown, the user intends to interact withvirtual element 202A, which corresponds to a flight plan. However, anactual user interaction with a user interface 120 may be impacted by avibration, such as a vibration due to turbulence, gravitational forces,or a mechanical vibration. For example, the actual user interaction, asdepicted by line B, may correspond with an unintended virtual element,such as virtual element 202B, which corresponds to a terrain map asshown in FIG. 2. In such a case, an actual user interaction may differfrom the intended user interaction due to a vibration-induced error.

Referring now to FIG. 3, a schematic of an example interaction with auser interface according to example aspects of the present disclosure isprovided. As depicted, a user interface 120 is displayed on a touchscreen display device 118. As shown, a user 206 has an object of visualfocus 208 in the user's eyesight. The object of visual focus 208 maycorrespond with one or more virtual elements, such as virtual elements202A-D shown in FIG. 2. As shown by line A, the user 206 intends tointeract with the object of visual focus 208. However, as shown by lineB, the actual user interaction with the user interface 120 occurs at anerror location 210, where the user's input device 204 (i.e., the user'sfinger) touches the touch screen display device 118. The touch screendisplay device 118 can be configured to provide data indicative of theactual user interaction to a processor in a control system, such as aprocessor in a control system 130 depicted in FIG. 1. For example, thedata indicative of the actual user interaction can be data correspondingto error location 210.

According to example aspects of the present disclosure, a trackingdevice 160 can be used to obtain data indicative of an intended userinteraction with a touch screen display device 118. For example, atracking device 160 can be a camera configured to track a user'seyesight. In another embodiment, a tracking device 160 could be anydevice or system configured to track an object of visual focus 208 of auser. The tracking device 160 can be configured to provide dataindicative of an object of visual focus 208 of the user 206 to aprocessor, such as processor in a control system 130 depicted in FIG. 1.For example, the tracking device 160 can provide a processor dataindicative of an object of visual focus 208, and the processor can beconfigured to determine the object of visual focus 208 of the user 206based on data provided.

The processor, such as a processor in a control system 130, can befurther configured to determine an input error 212 based on the datareceived by the touch screen display device 118 and tracking device 160.For example, a user may intend to interact with a particular virtualelement 202 on a touch screen display device 118, and in order tointeract with the virtual element 202, the user may focus on the virtualelement 202 as the user interacts with the touch screen display device118. Accordingly, the data indicative of an object of a visual focus 208can be data indicative of an intended user interaction. However, due toa vibration, such as turbulence, the user 206 may interact with thetouch screen display device at an error location 210. The processor,such as a processor in a control system 130, can be configured todetermine an input error 212 based at least in part on the dataindicative of the intended user interaction. The input error 212 may be,for instance, a difference between an actual user interaction (i.e., anerror location 210) on a touch screen display device 118 and an objectof the visual focus 208 of the user 206 (i.e. an intended userinteraction).

Referring now to FIG. 4, a schematic of an example interaction with auser interface according to example aspects of the present disclosure isprovided. As depicted, a user interface 120 is displayed on a touchscreen display device 118. As shown, an input device 204, such as auser's finger, is initially on a trajectory corresponding to a line Aduring interaction of the user with the touch screen display device 118before a sensed vibration 216 occurs.

According to example aspects of the present disclosure, a trackingdevice 160 can be used to obtain data indicative of a user's intendedinteraction with a touch screen display device 118. For example, atracking device 160 can be a camera configured to track the movement ofan input device 204, such as a user's finger, during interaction of auser with a touch screen display device 118. In another embodiment, atracking device 160 could be any other device or system configured totrack the movement of an input device 204, such as a wireless systemconfigured to track the movement of a stylus as the stylus interactswith a touch screen display device 118. The tracking device 160 can beconfigured to obtain data indicative of an intended user interaction,such as the movement of an input device 204 as the input device 204interacts with the touch screen display device 118. The tracking device160 can be further configured to provide data indicative of an intendeduser interaction, such as data regarding the movement of an input device204, to a processor, such as a processor in a control system 130depicted in FIG. 1.

As depicted in FIG. 4, as the input device 204 moves toward the touchscreen display device 118, a sensed vibration 216 occurs. As the sensedvibration 216 occurs, the user's actual movement corresponds to line B,rather than line A. The sensed vibration 216 may be a vibration, such asturbulence, a gravitational force, or a mechanical vibration. The sensedvibration 216 may be sensed by one or more vibration sensors 170 locatedon the aircraft. The vibration sensors 170 may obtain data indicative ofthe sensed vibration, such as data regarding the time, duration, andmagnitude of the sensed vibration 216, and provide the data indicativeof the sensed vibration 216 to a processor, such as a processor in acontrol system 130. As depicted in FIG. 4, following the sensedvibration 216, an actual user interaction, or an input, received by theinput device 204 occurs at error location 210 on the touch screendisplay device 118. The touch screen display device 118 can beconfigured to provide data indicative of the actual user interaction, orinput, such as data corresponding to error location 210 received by theinput device 204, to a processor.

The processor, such as a processor in a control system 130, can beconfigured to model an effect of the sensed vibration 216 on the inputdevice 204. For example, using data indicative of the actual userinteraction, such as data corresponding to an error location 210, anddata indicative of an intended user interaction, such as data indicativeof the movement of the input device 204 as it interacts with a touchscreen display device 118 obtained by a tracking device 160, theprocessor can determine a modeled input 214 had the sensed vibration 216not occurred. For example, the processor may determine that, had thesensed vibration not occurred, the input device 204 may have moved alonga line A to interact with the touch screen display device 118 at alocation corresponding to modeled input 214. As shown, line Acorresponding to an intended user input is a substantially straight lineas the input device 204 interacts with the touch screen display device118. However, a model of a user interaction need not be a straight-linemodel, but rather, can be any model configured to determine a modeledinput 214 had a sensed vibration 216 not occurred. Based on the locationof modeled input 214 and the error location 210, the processor can befurther configured to determine an input error 212. For example, theinput error can be a difference between the actual user interaction, orinput, received at error location 210 and the location of the modeledinput 212 had the sensed vibration 216 not occurred.

In an embodiment, the one or more tracking devices 160 can be furtherconfigured to determine an object of a visual focus of a user, such asan object of a visual focus 208 of a user 206 as depicted in FIG. 3, inaddition to tracking the movement of an input device 204. The dataindicative of an intended user interaction provided to the processor canfurther be data indicative of the object of the visual focus 208 of theuser 206. The processor can be configured to determine the input errorbased on determining a difference between the data indicative of theactual user interaction, or input, such as an error location 210, anddata indicative of the object of the visual focus of the user, such asthe object of the visual focus 208 of the user 206 as depicted in FIG.3.

Referring now to FIG. 5, a flow diagram of an example method (500)according to example embodiments of the present disclosure is depicted.The method (500) can be implemented by one or more processors, such as aprocessor in the control system 130 depicted in FIG. 1. In addition,FIG. 5 depicts steps performed in a particular order for purposes ofillustration and discussion. Those of ordinary skill in the art, usingthe disclosures provided herein, will understand that the various stepsof any of the methods disclosed herein can be modified, adapted,expanded, rearranged and/or omitted in various ways without deviatingfrom the scope of the present disclosure.

At (502), the method 500 can include providing for display a userinterface on a touch screen display device, the user interface includingone or more interactive virtual elements, each virtual elementassociated with a function to be performed by a component of theaircraft during operation of the aircraft. For example, a user interface120 can be provided for display on a touch screen display device 118.The user interface 120 can include one or more virtual elements, such asvirtual elements 202A-D depicted in FIG. 2. Each virtual element can beassociated with a function to be performed by a component of theaircraft during operation of the aircraft, such as opening a flight planmenu to allow for the entry of flight plan information, or displayingcurrent weather conditions nearby.

At (504), the method 500 can include receiving data indicative of anactual user interaction with the touch screen display device. Forexample, a processor in the control system 130 can receive dataindicative of an actual user interaction with a touch screen displaydevice 118, such as an interaction at an error location 210. The actualuser interaction can be a touch interaction on the touch screen displaydevice 118, which can be received by an input device, such as a finger,hand, arm or stylus. The touch screen display device 118 can send dataindicative of the actual user interaction to the processor of a controlsystem 130 and the processor of the control system 130 can receive thedata from the touch screen display device 118.

At (506), the method can include receiving data indicative of anintended user interaction. For example, a tracking device 160 can beconfigured to track a user as the user interacts with the touch screendisplay device 118. For example, the tracking device 160 can track anobject of visual focus of a user, such as an object of visual focus 208depicted in FIG. 3. Additionally, the tracking device 160 can beconfigured to track the movement of an input device, such as an inputdevice 204 as depicted in FIG. 4. The tracking device 160 can be, forexample, a camera. The data indicative of the intended user interactioncan be data indicative of the object of visual focus 208 of the user206, and/or the data indicative of the intended user interaction can bedata indicative of the movement of the input device 204. The processorof the control system 130 can receive the data indicative of theintended user interaction.

At (508), the method can include receiving data indicative of a sensedvibration. For example, a vibration sensor 170 can be located on theaircraft, and can be configured to sense a vibration on the aircraft,such as a turbulence, gravitational force, or mechanical vibration. Forexample, a sensed vibration can be a sensed vibration 216 as depicted inFIG. 4. The vibration sensor 170 can be configured to provide dataindicative of the sensed vibration to the processor in the controlsystem 130. The processor of the control system 130 can receive the dataindicative of the sensed vibration.

At (510), the method can include determining a corrected userinteraction corresponding to at least one selected virtual element basedat least in part on the data indicative of the actual user interaction,the data indicative of the intended user interaction, and the dataindicative of the sensed vibration. For example, the processor maydetermine that a sensed vibration caused an actual user interaction tobe different from an intended user interaction due to a sensedvibration. The processor may correct the user interaction to a correcteduser interaction corresponding to the intended user interaction. Thecorrected user interaction can correspond to at least one virtualelement, such as a virtual element 204A-D, displayed on a user interface120 on a touch screen display device 118.

Referring now to FIG. 6, a method (600) according to example embodimentsof the present disclosure is depicted. The method (600) can be used, forexample, to determine a corrected user interaction, such as a correcteduser interaction determined by a processor at (510) in a method (500).

At (602), the method can include determining an input error. Forexample, an input error can be based at least in part on a dataindicative of an intended user interaction received by a processor in acontrol system 130. The data indicative of an intended user interactioncan be data received from one or more tracking devices, such as one ormore tracking devices 160 depicted in FIGS. 2 and 3. The trackingdevices can be, for example, one or more cameras.

Additionally, the one or more tracking devices, such as one or moretracking devices 160, can be configured to track an object of a visualfocus of the user, as depicted in FIG. 3. The processor can beconfigured to determine the input error based at least in part on thedata provided by the one or more tracking devices. For example, atracking device 160 may track an object of a visual focus 208 of a user206. The tracking device 160 can provide data indicative of the objectof the visual focus 208 of the user 206 to the processor. The processormay also receive data indicative of an actual user interaction, such asdata indicative of an error location 210 received from a touch screendisplay device 118. The processor can be configured to determine aninput error, such as an input error 212 corresponding to a differencebetween the object of visual focus 208 and the error location 210.

Additionally and/or alternatively, the one or more tracking devices canbe configured to track the movement of an input device, such as an inputdevice 204 depicted in FIG. 4. The processor can be configured toreceive data indicative of the movement of the input device, and modelan input had a sensed vibration not occurred. For example, a processorcan determine a modeled input 214 had a sensed vibration 216 notoccurred based on data provided by a tracking device 160. The processorcan be further configured to determine an input error based on themodeled input and data indicative of an actual user interaction, such asan error location 210. For example, an input error can be a differencebetween the modeled input 214 and the error location 210.

At (604), the method can include determining a disturbance probability.The disturbance probability can be a probability that an input error wascaused by a sensed vibration. For example, a processor can receive dataindicative of a sensed vibration, such as data received by one or morevibration sensors 170. The data indicative of a sensed vibration can be,for example, data indicative of the magnitude of a vibration, the time avibration began, and the duration of the vibration. Based on the dataindicative of the sensed vibration, the processor can determine aprobability that an input error was caused by the sensed vibration. Forexample, if a large magnitude sensed vibration occurs at a timecoincident with a large input error, the processor may determine thatthere is a high likelihood that the input error was caused by the sensedvibration. Additionally, if little to no vibration occurred during auser interaction in which a large input error is determined, a processormay determine that there is a low likelihood that the input error wascaused by the sensed vibration.

At (606), the method can include determining whether a disturbanceprobability is high enough for a sensed vibration to have caused aninput error to have occurred. For example, if a disturbance probabilityis low and an input error is high, the processor can determine that theinput error was likely not caused by a sensed vibration. In such a case,the processor can disregard the input error, and determine the correcteduser interaction is the actual user interaction received by a touchscreen display device 118. Accordingly, the processor can use theoriginal input, or actual user interaction, as shown at (608). In thisway, a corrected user interaction can be based at least in part on thedisturbance probability.

If, however, the disturbance probability is high enough for a sensedvibration to have caused an input error to occur, at (610), theprocessor can determine whether the function corresponding to the actualuser interaction is a safety critical function. For example, an actualuser interaction could correspond to entering a flight plan parameterthat would avoid a collision with another aircraft. An intended userinteraction, by contrast, could correspond to entering a flight planparameter that would not avoid the collision with another aircraft. Insuch a case, the processor can determine that the actual userinteraction corresponds to a safety critical function, and coulddisregard the input error, and determine that the corrected userinteraction is the actual user interaction received by a touch screendisplay device 118. Accordingly, the processor can use the originalinput, or actual user interaction, as shown at (612). In this way, acorrected user interaction can be the data indicative of the actual userinteraction when the data indicative of the actual user interactioncomprises selection of a virtual element that comprises a safetycritical function.

If, however, the function corresponding to the actual user interactionis not a safety critical function, at (614), the processor can adjustthe actual user interaction, or input, by the input error. For example,as depicted in FIG. 3, an input error 212 can correspond to differencebetween an error location 210 and an object of a visual focus 208 of auser 206. The processor can determine that the user 206 intended tointeract with the touch screen display device 118 at a locationcorresponding to the object of visual focus 208. Accordingly, theprocessor can adjust data indicative of the actual user interactioncorresponding to the error location 210 by the input error 212. Thus,the corrected user interaction could be a location on the touch screendisplay device 118 corresponding to the object of visual focus 208.Further, the corrected user interaction can be a virtual element, suchas a virtual element 204A-D corresponding to the location of the objectof visual focus 208. Similarly, the corrected user interaction couldcorrespond to a virtual element corresponding to the modeled input 214,as depicted in FIG. 4. In this way, the corrected user interaction canbe a selected virtual element on the touch screen interfacecorresponding to the location of the data indicative of the actual userinteraction adjusted by the input error.

Referring back to FIG. 5, in response to determining a corrected userinteraction at (510), at (512), the method (500) can include sending oneor more command signals to one or more aircraft components to perform atleast a portion of the task associated with the at least one selectedvirtual element. For instance, the processor in a control system 130can, in response to the corrected user interaction, send one or morecommand signals to one or more aircraft components to perform at least aportion of a task associated with the selected virtual element. Forexample, a selected virtual element can be a virtual element associatedwith a flight plan, such as virtual element 202A depicted in FIG. 2. Theprocessor can send one or more command signals to a touch screen displaydevice 118 to open a menu corresponding to a flight plan in order toallow a flight crew member to enter or review flight plan information.Thus, as depicted in FIG. 2, while the actual user interactioncorresponded to a virtual element 202B, the processor can correct theuser interaction, and perform a function corresponding to the selectedvirtual element 202A. In this way, the method (500) according to exampleaspects of the present disclosure can correct a vibration-induced errorwith a touch screen display device.

FIG. 7 depicts an example system 700 according to example embodiments ofthe present disclosure. As shown, the system 700 can include a controlsystem 710 and one or more display devices 720. The control system 710can correspond to the control system 130 as described in exampleembodiments of the present disclosure. The one or more display devices720 can correspond to the one or more touch screen display devices 118as described in example embodiments of the present disclosure.

The control system 710 can include one or more processors 712 and one ormore memory devices 714. The control system 710 can also include anetwork interface used to communicate with the display device 720 and/orone or more aircraft components 730 over a network 740. The one or morecomponents 730 can include on or more aircraft control devices, one ormore display devices 110, and one or more touch screen display devices118. The network interface can include any suitable components forinterfacing with one more networks, including for example, transmitters,receivers, ports, controllers, antennas, or other suitable components.The network 740 can include a data bus or a combination of wired and/orwireless communication links. The network 740 can be any type ofcommunications network, such as a local area network (e.g. intranet),wide area network (e.g. Internet), cellular network, or some combinationthereof.

The one or more processors 712 can include any suitable processingdevice, such as a microprocessor, microcontroller, integrated circuit,logic device, or other suitable processing device. The one or morememory devices 714 can include one or more computer-readable media,including, but not limited to, non-transitory computer-readable media,RAM, ROM, hard drives, flash drives, or other memory devices. The one ormore memory devices 714 can store information accessible by the one ormore processors 712, including computer-readable instructions 716 thatcan be executed by the one or more processors 712. The instructions 716can be any set of instructions that when executed by the one or moreprocessors 712, cause the one or more processors 712 to performoperations.

As shown in FIG. 7, the one or more memory devices 714 can also storedata 718 that can be retrieved, manipulated, created, or stored by theone or more processors 712. The data 718 can include, for instance, dataassociated with virtual elements, tasks, control actions, and/or theaircraft control devices associated therewith. The data 718 can bestored in one or more databases. The one or more databases can beconnected to the control system 710 by a high bandwidth LAN or WAN, orcan also be connected to the control system 710 through network 740. Theone or more databases can be split up so that they are located inmultiple locales.

The display device 720 can include one or more processors 722 and one ormore memory devices 724. The display device 720 can also include anetwork interface used to communicate with the control system 710 and/orone or more aircraft control devices 710 over a network 740. The networkinterface can include any suitable components for interfacing with onemore networks, including for example, transmitters, receivers, ports,controllers, antennas, or other suitable components.

The one or more processors 722 can include any suitable processingdevice, such as a microprocessor, microcontroller, integrated circuit,logic device, or other suitable processing device. The one or morememory devices 724 can include one or more computer-readable media,including, but not limited to, non-transitory computer-readable media,RAM, ROM, hard drives, flash drives, or other memory devices. The one ormore memory devices 724 can store information accessible by the one ormore processors 722, including computer-readable instructions 726 thatcan be executed by the one or more processors 722. The instructions 726can be any set of instructions that when executed by the one or moreprocessors 722, cause the one or more processors 722 to performoperations. The instructions 726 can be executed by the one or moreprocessors 722 to display, for instance, a user interface on aninput/output device 727. The instructions 726 and/or other programsexecuted by the one or more processors 722 can allow a user to performfunctions on a screen surface such as providing user interactions (e.g.,touch, cursor) with virtual elements and inputting commands and otherdata through the screen surface.

The one or more memory devices 724 can also store data 728 that can beretrieved, manipulated, created, or stored by the one or more processors722. The data 148 can include, for instance, data associated with a userinterface, operations checklist, checklist items, tasks, virtualelements, and/or other information associated therewith. The data 728can be stored in one or more databases. The one or more databases can beconnected to the display device 720 by a high bandwidth LAN or WAN, orcan also be connected to the display device 720 through the network 740.The one or more databases can be split up so that they are located inmultiple locales.

The display device 720 can include an input/output device 727. Theinput/output device 727 can include a touch screen surface. Such touchscreen surface can include any suitable form including that of a liquidcrystal display (LCD) and can use various physical or electricalattributes to sense inputs and interactions from a user. Theinput/output device 727 can also include a trackball, mouse, othercursor device, touch pad, data entry keys, a microphone suitable forvoice recognition, and/or other suitable input devices. The input/output727 can also include other suitable output devices, such as other audioor visual outputs suitable for indicating the elements of a userinterface (e.g., tasks associated with checklist items).

The system 700 can include one or more vibration sensors 170. The one ormore vibration sensors 170 can be configured to provide data indicativeof a sensed vibration to the control system 710, as discussed herein.The system 700 can also include on or more tracking devices 160. The oneor more tracking devices can be configured to provide data indicative ofan intended user interaction, as discussed herein.

The technology discussed herein makes reference to computer-basedsystems, as well as, actions taken by and information sent to and fromcomputer-based systems. One of ordinary skill in the art will recognizethat the inherent flexibility of computer-based systems allows for agreat variety of possible configurations, combinations, and divisions oftasks and functionality between and among components. For instance,processes discussed herein can be implemented using a single computingdevice or multiple computing devices working in combination. Databases,memory, instructions, and applications can be implemented on a singlesystem or distributed across multiple systems. Distributed componentscan operate sequentially or in parallel.

Although specific features of various embodiments may be shown in somedrawings and not in others, this is for convenience only. In accordancewith the principles of the present disclosure, any feature of a drawingmay be referenced and/or claimed in combination with any feature of anyother drawing.

This written description uses examples to describe the presentdisclosure, including the best mode, and also to enable any personskilled in the art to practice the present disclosure, including makingand using any devices or systems and performing any incorporatedmethods. The patentable scope of the present disclosure is defined bythe claims, and may include other examples that occur to those skilledin the art. Such other examples are intended to be within the scope ofthe claims if they include structural elements that do not differ fromthe literal language of the claims, or if they include equivalentstructural elements with insubstantial differences from the literallanguages of the claims.

The invention claimed is:
 1. A computer-implemented method of correctinga vibration-induced input error on a touch screen display device on anaircraft, comprising: providing for display, by one or more processors,a user interface on a touch screen display device, the user interfacecomprising one or more interactive virtual elements, each virtualelement associated with a function to be performed by a component of theaircraft during operation of the aircraft; receiving, by the one or moreprocessors, data indicative of a touch interaction with the touch screendisplay device; receiving, by the one or more processors, dataindicative of an intended user interaction with the touch screen displaydevice; receiving, by the one or more processors, data indicative of asensed vibration from one or more vibration sensors located on theaircraft; determining, by the one or more processors, an input errorbased at least in part on the data indicative of the intended userinteraction and the data indicative of the touch interaction with thetouch screen display device; determining, by the one or more processors,a disturbance probability, the disturbance probability being aprobability that the input error was caused by the sensed vibration;determining, by the one or more processors, whether the disturbanceprobability is sufficiently high for the sensed vibration to have causedthe input error; determining, by the one or more processors, a correcteduser interaction corresponding to at least one selected virtual elementbased at least in part on whether the disturbance probability issufficiently high for the sensed vibration to have caused the inputerror: and in response to the corrected user interaction, sending, bythe one or more processors, one or more command signals to one or morecomponents of the aircraft to perform at least a portion of the functionassociated with the at least one selected virtual element.
 2. The methodof claim 1, wherein the data indicative of the intended user interactioncomprises data from one or more tracking devices.
 3. The method of claim2, wherein the one or more tracking devices are configured to track anobject of a visual focus of the user, wherein the data indicative of theintended user interaction comprises data indicative of the object of thevisual focus of the user.
 4. The method of claim 3, wherein the touchinteraction occurs at an error location, and wherein determining theinput error comprises determining a distance between the error locationof the touch interaction and a location of the object of the visualfocus of the user.
 5. The method of claim 2, wherein an input device isused for the touch interaction with the touch screen display device,wherein the one or more tracking devices are configured to track amovement of the input device, wherein data indicative of the intendeduser interaction comprises data indicative of the movement of the inputdevice.
 6. The method of claim 5, wherein the touch interaction occursat an error location, and wherein determining the input error comprisesmodeling an effect of the sensed vibration on the input device todetermine a location the touch interaction would have occurred had thesensed vibration not occurred, wherein the input error is descriptive ofa distance between the error location and the location the touchinteraction would have occurred had the sensed vibration not occurred.7. The method of claim 6, wherein the one or more tracking devices arefurther configured to determine an object of a visual focus of the user,wherein the data indicative of the intended user interaction furthercomprises data indicative of the object of the visual focus of the user,wherein determining the input error further comprises determining adifference between the data indicative of the touch interaction and thedata indicative of the object of the visual focus of the user.
 8. Themethod of claim 1, wherein the corrected user interaction comprisesselecting a virtual element on the touch screen interface correspondingto the location of the data indicative of the touch interaction adjustedby the input error.
 9. The method of claim 1, wherein the corrected userinteraction comprises the data indicative of the touch interaction whenthe data indicative of the touch interaction comprises selection of avirtual element that comprises a safety critical function.
 10. Themethod of claim 1, wherein the sensed vibration comprises at least oneof a turbulence, a gravitational force, or a mechanical vibration. 11.The method of claim 1, wherein the data indicative of the sensedvibration indicates a time, a duration, and a magnitude of the sensedvibration.
 12. A system for correcting a vibration-induced input erroron a touch screen display device on an aircraft, comprising: a touchscreen display device configured to display a user interface, the userinterface comprising one or more interactive virtual elements, eachvirtual element associated with a function to be performed by acomponent of the aircraft during operation of the aircraft; one or morevibration sensors located on the aircraft and configured to obtain dataindicative of a sensed vibration; one or more tracking devicesconfigured to obtain data indicative of an intended user interaction;and a control system configured to: receive data indicative of a touchinteraction with at least one virtual element; receive data indicativeof an intended user interaction with the touch screen display device;receive data indicative of a sensed vibration; determine an input errorbased at least in part on the data indicative of the intended userinteraction and the data indicative of the touch interaction; determinea disturbance probability, the disturbance probability being aprobability that the input error was caused by the sensed vibration;determine whether the disturbance probability is sufficiently high forthe sensed vibration to have caused the input error; determine acorrected user interaction corresponding to at least one selectedvirtual element based at least in part on whether the disturbanceprobability is sufficiently high for the sensed vibration to have causedthe input error; and in response to the corrected user interaction, tosend one or more command signals to one or more components of theaircraft to perform at least a portion of the task associated with theat least one selected virtual element.
 13. The system of claim 12,wherein the one or more tracking devices are configured to determine anobject of a visual focus of the user, wherein the data indicative of theintended user interaction comprises data indicative of the object of thevisual focus of the user, wherein determining the input error comprisesdetermining a difference between the data indicative of the touchinteraction and the data indicative of the object of the visual focus ofthe user.
 14. The system of claim 12, wherein the data indicative of thetouch interaction comprises an input on the touch screen display devicereceived by an input device, wherein the one or more tracking devicesare configured to track a movement of the input device, whereindetermining the input error comprises modeling an effect of the sensedvibration on the input device, wherein the input error comprises adifference between the input and a modeled input had the sensedvibration not occurred.
 15. An aircraft, comprising: an engine; afuselage; one or more vibration sensors; one or more tracking devices; atouch screen display device; and a controller comprising one or moreprocessors and one or more memory devices located on an aircraft, theone or more memory devices storing instructions that when executed bythe one or more processors cause the one or more processors to performoperations, the controller configured to: provide for display a userinterface on the touch screen display device, the user interfacecomprising one or more interactive virtual elements, each virtualelement associated with a function to be performed by a component of theaircraft during operation of the aircraft; receive data indicative of anactual user interaction with the touch screen display device, the actualuser interaction indicative of an actual input location at which thetouch screen display device is touched; receive data indicative of asensed vibration from the one or more vibration sensors; receive dataindicative of a trajectory of an input device from the one or moretracking devices; determine an intended user interaction based at leastin part on the received data indicative of the sensed vibration and thereceived data indicative of the trajectory of the input device, theintended user interaction indicative of an intended input location atwhich the touch screen display device was intended to be touched;determine an input error descriptive of a distance between the actualinput location and the intended input location and a direction of theactual input location relative to the intended input location; determinea disturbance probability, the disturbance probability being aprobability that the input error was caused by the sensed vibration;determine whether the disturbance probability is sufficiently high forthe sensed vibration to have caused the input error; determine acorrected user interaction corresponding to at least one selectedvirtual element based at least in part on whether the disturbanceprobability is sufficiently high for the sensed vibration to have causedthe input error; and in response to the corrected user interaction,sending one or more command signals to one or more components of theaircraft to perform at least a portion of the function associated withthe at least one selected virtual element.
 16. The aircraft of claim 15,wherein the intended input location is a location modeled based at leastin part on the received data indicative of the sensed vibration.
 17. Theaircraft of claim 16, wherein the intended input location is a locationcorresponding to an object of visual focus.
 18. The aircraft of claim17, wherein the one or more interactive virtual elements remain in fixedlocations on the touch screen display device from commencement of theintended user interaction to at least until the actual user interactionwhen the input device touches the touch screen display device.